Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kubernetes manifests for Heartbeat #17928

Merged
merged 6 commits into from
Jul 22, 2020

Conversation

exekias
Copy link
Contributor

@exekias exekias commented Apr 23, 2020

What does this PR do?

Add Kubernetes example manifests for Heartbeat, with some examples on how to use autodiscover there.

Related issues

Closes #17752

@exekias exekias added enhancement in progress Pull request is currently in progress. containers Related to containers use case Team:obs-ds-hosted-services Label for the Observability Hosted Services team Team:Platforms Label for the Integrations - Platforms team labels Apr 23, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/uptime (:uptime)

@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@exekias exekias requested a review from a team as a code owner April 23, 2020 09:27
Copy link
Member

@jsoriano jsoriano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

[WARNING]
=======================================
If you are using Kubernetes 1.7 or earlier: {beatname_uc} uses a hostPath volume to persist internal data, it's located
under /var/lib/{beatname_lc}-data. The manifest uses folder autocreation (`DirectoryOrCreate`), which was introduced in
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems that there is no DirectoryOrCreate volume in the manifests.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch! 0db39e7

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@exekias
Copy link
Contributor Author

exekias commented Apr 27, 2020

@andrewvc PTAL, happy to go over these changes together

@exekias exekias changed the title Heartbeat kubernetes Add kubernetes manifests for Heartbeat Apr 27, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Apr 30, 2020

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Branch indexing]

  • Start Time: 2020-05-13T15:27:04.016+0000

  • Duration: 124 min 13 sec (7452955)

Log output

Expand to view the last 100 lines of log output

[2020-05-13T16:47:52.101Z] + FILE=packetbeat/build/coverage/full.cov
[2020-05-13T16:47:52.101Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-05-13T16:47:52.101Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-05-13T16:47:52.101Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-05-13T16:47:52.101Z] + FILE=journalbeat/build/coverage/full.cov
[2020-05-13T16:47:52.101Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-05-13T16:47:55.332Z] Stage "Elastic Agent x-pack" skipped due to when conditional
[2020-05-13T16:47:55.333Z] Stage "Elastic Agent x-pack Windows" skipped due to when conditional
[2020-05-13T16:47:55.335Z] Stage "Elastic Agent Mac OS X" skipped due to when conditional
[2020-05-13T16:47:55.337Z] Stage "Filebeat oss" skipped due to when conditional
[2020-05-13T16:47:55.339Z] Stage "Filebeat x-pack" skipped due to when conditional
[2020-05-13T16:47:55.340Z] Stage "Filebeat Mac OS X" skipped due to when conditional
[2020-05-13T16:47:55.341Z] Stage "Filebeat Windows" skipped due to when conditional
[2020-05-13T16:47:55.343Z] Stage "Auditbeat oss" skipped due to when conditional
[2020-05-13T16:47:55.347Z] Stage "Auditbeat x-pack" skipped due to when conditional
[2020-05-13T16:47:55.348Z] Stage "Libbeat" skipped due to when conditional
[2020-05-13T16:47:55.351Z] Stage "Libbeat x-pack" skipped due to when conditional
[2020-05-13T16:47:55.352Z] Stage "Metricbeat OSS Unit tests" skipped due to when conditional
[2020-05-13T16:47:55.354Z] Stage "Metricbeat OSS Integration tests" skipped due to when conditional
[2020-05-13T16:47:55.356Z] Stage "Metricbeat Python integration tests" skipped due to when conditional
[2020-05-13T16:47:55.358Z] Stage "Metricbeat x-pack" skipped due to when conditional
[2020-05-13T16:47:55.361Z] Stage "Metricbeat crosscompile" skipped due to when conditional
[2020-05-13T16:47:55.363Z] Stage "Metricbeat Mac OS X" skipped due to when conditional
[2020-05-13T16:47:55.364Z] Stage "Metricbeat Windows" skipped due to when conditional
[2020-05-13T16:47:55.365Z] Stage "Packetbeat" skipped due to when conditional
[2020-05-13T16:47:55.367Z] Stage "dockerlogbeat" skipped due to when conditional
[2020-05-13T16:47:55.367Z] Stage "Winlogbeat" skipped due to when conditional
[2020-05-13T16:47:55.368Z] Stage "Winlogbeat Windows x-pack" skipped due to when conditional
[2020-05-13T16:47:55.369Z] Stage "Functionbeat" skipped due to when conditional
[2020-05-13T16:47:55.369Z] Stage "Journalbeat" skipped due to when conditional
[2020-05-13T16:47:55.369Z] Stage "Generators" skipped due to when conditional
[2020-05-13T16:47:55.863Z] Stage "Auditbeat oss" skipped due to when conditional
[2020-05-13T16:47:55.865Z] Stage "Libbeat" skipped due to when conditional
[2020-05-13T16:47:55.866Z] Stage "Metricbeat x-pack" skipped due to when conditional
[2020-05-13T16:47:55.866Z] Stage "Packetbeat" skipped due to when conditional
[2020-05-13T16:47:55.867Z] Stage "dockerlogbeat" skipped due to when conditional
[2020-05-13T16:47:55.868Z] Stage "Winlogbeat" skipped due to when conditional
[2020-05-13T16:47:55.868Z] Stage "Functionbeat" skipped due to when conditional
[2020-05-13T16:47:55.869Z] Stage "Journalbeat" skipped due to when conditional
[2020-05-13T16:47:55.870Z] Stage "Generators" skipped due to when conditional
[2020-05-13T16:47:57.682Z] Stage "Auditbeat oss" skipped due to when conditional
[2020-05-13T16:47:57.684Z] Stage "Libbeat" skipped due to when conditional
[2020-05-13T16:47:57.686Z] Stage "Metricbeat x-pack" skipped due to when conditional
[2020-05-13T16:47:57.687Z] Stage "Winlogbeat" skipped due to when conditional
[2020-05-13T16:47:57.688Z] Stage "Functionbeat" skipped due to when conditional
[2020-05-13T16:47:57.689Z] Stage "Generators" skipped due to when conditional
[2020-05-13T16:47:58.514Z] Stage "Auditbeat oss" skipped due to when conditional
[2020-05-13T16:47:58.516Z] Stage "Libbeat" skipped due to when conditional
[2020-05-13T16:47:58.519Z] Stage "Functionbeat" skipped due to when conditional
[2020-05-13T16:47:58.520Z] Stage "Generators" skipped due to when conditional
[2020-05-13T16:47:59.074Z] Stage "Auditbeat oss" skipped due to when conditional
[2020-05-13T16:47:59.075Z] Stage "Generators" skipped due to when conditional
[2020-05-13T16:48:10.513Z] Still waiting to schedule task
[2020-05-13T16:48:10.513Z] All nodes of label ‘ubuntu&&immutable’ are offline
[2020-05-13T16:48:10.660Z] Still waiting to schedule task
[2020-05-13T16:48:10.660Z] All nodes of label ‘ubuntu&&immutable’ are offline
[2020-05-13T17:30:48.882Z] Cancelling nested steps due to timeout
[2020-05-13T17:30:50.036Z] Failed in branch Heartbeat
[2020-05-13T17:30:50.039Z] Failed in branch Kubernetes
[2020-05-13T17:30:50.460Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17928/src/github.com/elastic/beats
[2020-05-13T17:30:51.044Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-13T17:30:51.172Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17928/src/github.com/elastic/beats/Lint
[2020-05-13T17:30:52.334Z] + cat
[2020-05-13T17:30:52.334Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-13T17:30:52.334Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-13T17:30:59.938Z] runbld>>> runbld started
[2020-05-13T17:30:59.938Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-13T17:31:01.190Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-17928' in order of occurrence in the config (last value wins).
[2020-05-13T17:31:02.444Z] runbld>>> Debug logging enabled.
[2020-05-13T17:31:02.444Z] runbld>>> Storing result
[2020-05-13T17:31:02.906Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-13T17:31:02.930Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200513173102-934A44AC
[2020-05-13T17:31:02.930Z] runbld>>> Adding system facts.
[2020-05-13T17:31:03.725Z] runbld>>> Adding vcs info for the latest commit:  7d1808246271cdd5a658dc6e31e341d31979181a
[2020-05-13T17:31:03.725Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-13T17:31:03.725Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-13T17:31:03.725Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-13T17:31:03.725Z] Processing JUnit reports with runbld...
[2020-05-13T17:31:04.173Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-13T17:31:04.173Z] runbld>>> DURATION: 11ms
[2020-05-13T17:31:04.173Z] runbld>>> STDOUT: 40 bytes
[2020-05-13T17:31:04.173Z] runbld>>> STDERR: 49 bytes
[2020-05-13T17:31:04.173Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-13T17:31:04.173Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17928/src/github.com/elastic/beats
[2020-05-13T17:31:05.469Z] runbld>>> Storing build metadata: 
[2020-05-13T17:31:05.469Z] runbld>>> Adding test report.
[2020-05-13T17:31:05.469Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17928/src/github.com/elastic/beats
[2020-05-13T17:31:06.701Z] runbld>>> Found 0 test output files
[2020-05-13T17:31:06.701Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 0 Skipped: 0
[2020-05-13T17:31:06.701Z] runbld>>> Storing result
[2020-05-13T17:31:07.033Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-13T17:31:07.033Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200513173102-934A44AC
[2020-05-13T17:31:07.033Z] runbld>>> Email notification disabled by environment variable.
[2020-05-13T17:31:07.033Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-13T17:31:15.260Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17928
[2020-05-13T17:31:15.614Z] [INFO] getVaultSecret: Getting secrets
[2020-05-13T17:31:15.719Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-13T17:31:17.363Z] + chmod 755 generate-build-data.sh
[2020-05-13T17:31:17.363Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17928/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17928/runs/11 ABORTED 7452955
[2020-05-13T17:31:17.914Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17928/runs/11/steps/?limit=10000 -o steps-info.json

@elasticmachine
Copy link
Collaborator

elasticmachine commented Jun 2, 2020

💚 Build Succeeded

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #17928 updated]

  • Start Time: 2020-07-21T16:27:40.986+0000

  • Duration: 69 min 6 sec

Test stats 🧪

Test Results
Failed 0
Passed 1200
Skipped 28
Total 1228

Copy link
Contributor

@andrewvc andrewvc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

exekias pushed a commit to exekias/beats that referenced this pull request Jul 27, 2020
* Add kubernetes manifests for Heartbeat

(cherry picked from commit 16759ab)
exekias pushed a commit that referenced this pull request Jul 28, 2020
…0235)

* Add kubernetes manifests for Heartbeat (#17928)

* Add kubernetes manifests for Heartbeat

(cherry picked from commit 16759ab)

* make update
exekias pushed a commit to exekias/beats that referenced this pull request Jul 29, 2020
* Add kubernetes manifests for Heartbeat

(cherry picked from commit 16759ab)
@exekias exekias added the v7.9.0 label Jul 29, 2020
exekias pushed a commit that referenced this pull request Jul 30, 2020
…0299)

* Add kubernetes manifests for Heartbeat (#17928)

* Add kubernetes manifests for Heartbeat

(cherry picked from commit 16759ab)

* make update

* Add ECK notice
@jsoriano jsoriano mentioned this pull request Aug 26, 2020
6 tasks
melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020
* Add kubernetes manifests for Heartbeat
@zube zube bot removed the [zube]: Done label Oct 21, 2020
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
…eat (elastic#20299)

* Add kubernetes manifests for Heartbeat (elastic#17928)

* Add kubernetes manifests for Heartbeat

(cherry picked from commit 8900d6d)

* make update

* Add ECK notice
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
containers Related to containers use case enhancement in progress Pull request is currently in progress. Team:obs-ds-hosted-services Label for the Observability Hosted Services team Team:Platforms Label for the Integrations - Platforms team v7.9.0 v7.10.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add kubernetes manifests for Heartbeat
6 participants